Fluctuation Ratios in the Absence of Microscopic Time Reversibility 
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We study fluctuations in diffusion-limited reaction systems driven out of their stationary state. 
Using a numerically exact method, we investigate fluctuation ratios in various systems which differ by 
their level of violation of microscopic time reversibility. Studying a quantity that for an equilibrium 
system is related to the work done to the system, we observe that under certain conditions oscillations 
appear on top of an exponential behavior of transient fluctuation ratios. We argue that these 
oscillations encode properties of the probability currents in state space. 
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In recent years the study of fluctuations in nonequi- 
Ubriuni small systems has evolved into a very active 
field of researchj_^ see, e^-, El, S, IE 0, H, H, S S 
S, [IS El, [11 IS, Q, E lla [S 111- various fluc- 



tuation and work theorems have been formulated and 
their applicability has been verifled in recent experiments 
[H Hj, Hi, m Hi, [13, El], demonstrating their use- 
fulness for characterizing out-of-equilibrium systems. It 
is remarkable that these fluctuation relations yield very 
generic statements valid for large classes of nonequilib- 
rium systems. 

Diffusion-limited systems with irreversible reactions 
form an important class of systems that have not been 
studied thoroughly in the context of fluctuation relations. 
In the past all discussed extensions of fluctuation theo- 
rems to nonequilibrium systems with chemical reactions 
ii,[23,[2l|,[2l[2i,l2i,[25| focused on reversible reactions 
and reaction networks. Effectively, however, irreversible 
reactions can be encountered if the products of the re- 
actions are evacuated rapidly enough. What makes irre- 
versible reactions so interesting is that there is a major 
qualitative difference with reversible reactions: whereas 
in the latter case microscopic time reversibility holds, in 
irreversible reaction-diffusion systems microscopic time 
reversibility is usually broken. As we show in this Letter 
the absence of microscopic reversibility leads to unex- 
pected and nontrivial modifications of the properties of 
transient fiuctuations. 

Systems with broken microscopic time reversibility are 
readily found in granular matter. It has been claimed 
[2^ that fiuctuations in fiuidized granular medium arc 
in accord with the Gallavotti and Cohen fluctuation the- 
orem. As the fluctuation theorem requires microscopic 
reversibility, this interpretation of the experimental data 
is problematic and has been criticized [27|. However, in 
[28| it has been proposed that under certain assumptions 
and for a speciflc timescale a fluctuation relation should 
be recovered in granular materials. In our study we will 
not be able to contribute directly to this controversy, but 
the results presented in this Letter clearly show the inter- 
esting and nontrivial character of fluctuations in systems 
in which microscopic reversibility is absent. 



In diffusion-limited reaction systems the stationary 
states can be true nonequilibrium states. Due to their 
relative simplicity, in conjunction with a highly non- 
trivial physical behavior, reaction-diffusion systems are 
considered to be paradigmatic examples of nonequilib- 
rium many-body systems. Thus our current understand- 
ing of nonequilibrium phase transitions (29j and of ag- 
ing phenomena in absence of detailed balance jsO] has 
mainly emerged through numerous studies of the out-of- 
equilibrium behavior of these systems. 

We consider here one-dimensional lattices of N sites 
with periodic boundary conditions. Forbidding multiple 
occupancy of a given lattice site, particles A jump to un- 
occupied nearest neighbor sites with a diffusion rate D 
and undergo various reactions. We discuss in the follow- 
ing three different reaction schemes, see Table HI and we 
denote with model 1, 2, and 3 the three models that result 
from these reaction schemes. Obviously, the reactions 
change the number of particles in the system, whereas 
the diffusion keeps the particle number constant. 



model 1 


model 2 


model 3 


A+A^O+A 
A + O-^A + A 


A + A^O + A 
O^A 


A + A^O + 
O^A 



TABLE I: The three reaction schemes discussed in this Letter. 
A new particle can only be created at an empty lattice site. 

For flxed values of the reaction and diffusion rates, 
model 1 is in (chemical) equilibrium. This is different 
for the other two models where microscopic reversibil- 
ity is partly or fully broken. By breaking microscopic 
reversibility we mean that if lu{C — > C) is the tran- 
sition probability from configuration C to configuration 
C", we can have the situation that Ld{C — > C) — even 
though uj{C' — > C) > 0. For model 2 we observe that 
some reactions are reversible whereas others are not. For 
example, whereas we can create a new particle in the 
middle of two empty sites, 000 — > OAO with rate /i, it is 
not possible to directly go back to the configuration with 
three empty sites by destroying this isolated A particle, 
as we need to have two neighboring A particles for par- 
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tide annihilation. This is different for OOA — > OAA, as 
here a direct path back to the initial configuration exists. 
Finally, in model 3 microscopic reversibility is broken for 
all reactions. 

We can readily access the stationary probability dis- 
tributions, i.e. the probabilities Ps{Ci) to encounter the 
microscopic configuration Ci in a given stationary state. 
This is done in the usual way by rewriting the master 
equations in matrix form involving the Liouvillian and 
by noticing that the stationary probabilities form the 
unique eigenvector of this operator to the eigenvalue 0. 
With N sites we have 2^ configurations as there is at 
most one particle on each lattice site. The null eigen- 
vector of the resulting 2^ x 2^ matrix is obtained us- 
ing standard algorithms. Figure [T] shows the stationary 
probability distributions for three different cases. Config- 
urations with the same number of particles are grouped, 
with the empty configuration to the left and the fully 
occupied lattice to the right. When the creation of new 
particles takes place with a small rate, see Fig. [T^ and 
[TJd, the most probable configurations are those with few 
occupied sites, whereas the configurations with more oc- 
cupied sites have an increasing weight for increasing cre- 
ation rates. Similar changes are observed when changing 
the rate A. Obviously, a change of reaction rates has a 
large impact on the stationary probability distributions. 
This is different for the diffusion constant D which only 
changes the distributions quantitatively and not qualita- 
tively, as shown in Fig. [TJ;. We remark that even though 
there are visible differences in the stationary probability 
distributions, it is far from obvious how one should in- 
fer from these distributions the equilibrium (model 1) or 
strongly nonequilibrium (model 3) nature of the system. 
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FIG. 1: (Color online) Stationary probability distributions 
for (a) model 1 with A = 1 and D = 1, (b) model 3 with 
A = 1 and D = 1, and (c) model 2 with A = 1 and h = 1.4. 
Shown are the distributions for two values of the creation 
rate h respectively of the diffusion constant D for systems 
with N — 8 lattice sites. The configurations are grouped by 
number of particles. 

In order to get a better understanding of our systems 
we look at the transient behavior when we drive the sys- 
tem from one stationary state to another by changing a 
reaction rate. Experimentally, a change of rates in chem- 
ical reactions can be achieved by changing the tempera- 
ture. In our protocol we change one of the rates r from 
an initial value tq to a final value tm in M equidistant 
steps of length Ar, yielding the values = rg +iA.r with 



i = 0, • ■ • , M. We compute the observable (9| 

Af-l 

S(t>^J2 (ln-P.(a,r.+i)-lnP,(C„rO) (1) 

i=0 

where Ps{Ci, hi) is the probability to find the configura- 
tion Ci in the stationary state corresponding to the value 
r,; of the reaction rate r. For a system in thermal equi- 
librium the quantity 5(j) is given by 5(j) — PiW — Ai^), 
where is the inverse temperature, W is the work done 
to the system, and AF is the difference between the free 
energies of the initial and final states. It is important to 
note that the quantity ([1]) is still well defined in absence 
of microscopic reversibility. This is not the case for many 
of the quantities that have been studied recently in the 
context of fluctuation relations. 

Hatano and Sasa [9] proved for Langevin systems with 
continuous dynamics that the quantity ([1]) fulfills in the 
limit M — > oo the following simple fluctuation relation: 



(e^**) = 1 



(2) 



where the average is the average over all possible histories 
relating the initial and final steady states. For an equi- 
librium system the relation ([2]) reduces to the well-known 
Jarzynski relation ^^]. Even though not explicitly stated 
in P , the property ^ of Jt/f can be shown in a straight- 
forward way to also hold in systems with discrete dy- 
namics, and this independently on whether microscopic 
reversibility prevails or not. The verification of the rela- 
tion ([2|) is therefore a very good benchmark in order to 
validate our numerical approach. 

Changing the rate r from the initial value tq to the fi- 
nal value tm in steps, we can easily compute the exact 
stationary probability distributions for any value with 
i = 0, • • • , M. In order to verify Eq. ([2]) we need to gener- 
ate all possible sequences of configurations {paths in con- 
figuration space) Co — > Ci — > ■ • • — > Gm-i — >■ Cm, 



M 



^)^{C, 



determine the weights J| Ps{C, 

and the values of 54) along the different paths, and aver- 
age over all these possibilities. Here a;(Ci — > Ci+i,ri+i 
is the transition probability from configuration Ci to con- 
figuration Ci+i at the value ri+i of our reaction rate. 
With this numerical exact calculation we verify for all 
studied cases the validity of the integral fluctuation rela- 
tion ([2]) with deviations less than 10~^. 

As in our numerically exact approach we generate all 
paths recursively, the CPU time needed for the genera- 
tion of all trajectories grows exponentially with the lat- 
tice size N and the number of steps M, and only rather 
small system sizes (with TV < 10) can be accessed in this 
way. For example, for iV = 8 we generate 2.6 10® differ- 
ent trajectories for M = 6, whereas 2.7 10^° trajectories 
are generated for M = 8. We also studied larger systems 
through A/Ionte Carlo simulations and checked that these 
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results are consistent with the numerical exact results ob- 
tained for the small systems. For this reason we focus in 
the following on the numerically exact results and defer 
a discussion of the Monte Carlo simulations to later 31 1 . 



Before discussing the detailed fluctuation relation, let 
us first look at the probability distribution Pp{S(j)) of 
the quantity Scj) for the forward process where the rate 
r is changed from rp to tm as well as at the probability 
distribution Pii{64>) for the reversed process where r is 
changed from tm to tq. In the reversed process the rate 
r takes on the same values as in the forward process but 
in the reversed order. We show in Figure [2] the result- 
ing probability distributions for the three models with 
N = 8 sites where we change the creation rates from 
ho = 0.2 to hj^i = 1.4 in M = 8 equidistant steps. Inter- 
estingly, the probability distributions are skewed distri- 
butions that exhibit additional intriguing peaks. Increas- 
ing the diffusion rate D leads to a sharpening of these 
peaks, as is shown in Figure [3] for model 3 with M = 6 
and different values of D. We checked that the main 
contributions to these peaks comes from those trajecto- 
ries in configuration space where diffusion steps abound, 
whereas reactions, which change the number of particles 
in the system, only take place rarely. It should be noted 
that for very large values of D the peaks also appear for 
the equilibrium model 1 and are therefore not character- 
istic of broken microscopic time reversibility. 




FIG. 2: (Color online) Probability distributions Pf and Pr 
as a function of 5<j!> for the forward and reverse processes: 
(a) model 1, (b) model 2, (c) model 3, with A = 1, D = 1, 
and N — 8. In all cases the rate of particle creation was 
changed from ho = 0.2 to /im = 1.4 in M = 8 steps. The 
scattering in the data is not due to poor statistics, as we are 
using a numerical exact method for the computation of the 
probability distributions. 

In Figure H] we discuss the fluctuation ratio 
PpiScj)) / Pu{—S(j)) for the observable H]). For a system 
that fulfills detailed balance for all values of the rate r 
we expect that 



PF{S^)/PR{-S(t>) = exp((50) 



(3) 



Indeed, it is straightforward to show that for a system 
initially in thermal equilibrium relation ([3|) together with 
the definition ^ of the quantity Scj) yields the Crooks 
relation 




-e- 



10 



f M' (b) 



5(|) 



FIG. 3: (Color online) Probability distributions Pf (a) and 
Pr (b) as a function of Sep for model 3 with A = 1, A'' = 8, 
and h changing from ho = 0.2 to hM — 1.4 in M — 6 steps. 
The peaks are more pronounced for larger values of D. 



In order to highlight any deviations from the exponen- 
tial behavior, we plot in the lower panels of Fig. 2] the 
quantity e~^'^ Pf{6(1)) / PR{-5(t)). Looking at Fig. [4ji and 
UJi, we observe that for the equilibrium model 1 the ra- 
tio of the two probability distributions indeed displays a 
perfect exponential behavior. As the probability distri- 
butions themselves are skewed distributions, see Fig. [21 
this is a nontrivial result that nicely demonstrates the 
importance of the Crooks relation. 
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Pf{W)/Pr{-W) = exp [(3{W - AF)] 



(4) 



FIG. 4; (Color online) Ratio PF{Scj>)/ PR{—5cj>) as a function 
of 50 for (a) and (d) model 1, (b) and (e) model 2, and (c) and 
(f) model 3, with A = 1, D = 1, iV = 8, and M = 8, whereas 
h is changed from ho — 0.2 to hM = 1.4. In the lower panels 
we plot e~^'^ Pf{3(I)) / PR{—5(j>) in order to highlight deviations 
from the equilibrium behavior Q. The dashed lines indicate 
the expected behavior ([3} for a system in equilibrium before 
and after the change of parameter. 

As already discussed, microscopic reversibility is partly 
broken for model 2: whereas many trajectories in con- 
figuration space are fully reversible, this does not hold 
true for all of them. We observe that the probability 
distribution ratio still displays an exponential behavior 
on average, see Fig. |4)d, but the data do not fall any 
more exactly on the exponential curve but instead are 
scattered around that curve (Fig. 2^). 

For model 3, where microscopic reversibility is absent, 
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a remarkable change takes place and systematic devi- 
ations from the exponential behavior are observed, see 
Fig. 21: and|3f. These deviations take the form of oscilla- 
tions. As we argue in the following, these deviations re- 
veal properties of the probability currents in state space. 

In order to develop a better understanding for the ori- 
gin of these oscillations, we studied systematically the 
dependence of this feature on the reaction and diffusion 
rates as well as on the system size and the number M of 



elementary steps [3l|. In fact, the oscillations are very 



robust and are encountered for all studied values of the 
system parameters. We also observe that a change of the 
positions of the peaks is directly related to a qualitative 
change of the stationary probability distributions, as the 
position of the peaks strongly shift when the reaction 
rates are changed, but do only change slightly when the 
diffusion constant is modified. Changing the diffusion 
constant, however, greatly enhances the peak height. 

At this stage one might think that the peaks observed 
in the probabilities Pp and Pr, see Fig. [2]and[3l are the 
origin of the peaks in the probability ratio. On the one 
hand, there is of course an intimate relation between the 
peaks in Pp and Pr and those encountered when taking 
the ratio of these two probabilities. On the other hand, 
however, peaks also appear in Pp and Pr for models 2 
and 1, even though no peaks are observed for the corre- 
sponding ratio. The appearance of peaks in the proba- 
bilities Pp and Pr is therefore a necessary condition, but 
it alone can not explain our observations. 

It is important to note that model 3 differs qualita- 
tively from models 1 and 2. For all the models the con- 
figuration space is divided into different subspaces, char- 
acterized by a constant number of particles in the sys- 
tem, which are invariant under the action of diffusion. A 
passage from one subspace to the other only takes place 
when the number of particles is changed by a reaction. 
In models 1 and 2 every reaction changes the number of 
particles by one, thus connecting different subspaces pair- 
wise. One of the consequences of this is that the peaks 
in the distributions Pp and Pr compensate each other 
when computing the ratio Pp{6(j))/ Pr{—S(I)). This com- 
pensation is only approximate for model 2 due to the fact 
that some trajectories can not be travelled in the reversed 
direction when reversing the protocol. The situation is 
different for model 3 as here we have an asymmetry in 
the change of particle numbers: whereas the number of 
particles is enhanced by one in the creation process, two 
particles are always destroyed in the annihilation process. 
Consequently, the trajectories in configuration space for 
the forward and backward processes are completely dif- 
ferent, as they connect the different subspaces with fixed 
number of particles in a different way. It follows that 
probability currents for the forward and backward pro- 
cess are also very different. This yields probability distri- 
butions Pp and Pfj whose peaks do not compensate each 
other when the ratio is formed, thus giving place to the 



observed systematic deviations. It is clear from this dis- 
cussion that we expect this mechanism, and therefore the 
observed systematic deviations, to be common in systems 
where the absence of microscopic reversibility is accom- 
panied by an asymmetry in the probability currents in 
configuration space. 

In summary, we have studied reaction-diffusion sys- 
tems and showed that the absence of microscopic re- 
versibility can lead for transient fluctuation ratios for the 
observable 50 to systematic deviations from the expo- 
nential behavior encountered in systems with equilibrium 
steady states. These deviations take the form of oscilla- 
tions, and we argue that this intriguing feature reveals 
properties of the probability ciurents in state space. 
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Frederic van Wijland and Royce Zia for interesting and 
helpful discussions. 
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